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Description 

[0001] This invention relates to the field of electronic 
still cameras and more particularly to electronic still 
cameras which hav an integral printer capable of print- 5 
ing audio and visual information. 
[0002] Systems for providing audio recording and 
playback in association with individual electronic still 
prints are known in the art. Examples of such systems 
are disclosed in US-A-3,439,598; US-A-4,270,853; US- to 
A-4,270,854; US-A-4,905,029; and US-A-5,276,472. In 
the '598 patent, a belt driven recording needle inscribes 
audio information in spiral grooves on the back layer of 
a multilaminate slide film. This requires special film and 
film processing that would allow for removal of the re- is 
cording film laminate and its attachment to the slide 
frame for playback by needle-based playback appara- 
tus. In the '854 patent, sound is recorded on an instant 
print by placing the print, after it has been ejected, into 
an auxiliary slot in the camera and then proceeding to 20 
record the audio on a magnetic strip on the print border. 
With this system, audio can only be recorded after the 
picture has been captured and only on an instant print. 
Also, the only way disclosed for playback is with the 
camera. The '853 patent discloses a similar apparatus *s 
for an instant print camera for recording audio on a mag- 
netic strip in the margin of the instant print paper within 
a film pack. The '029 patent discloses a microphone and 
tape recording mechanism to record sound in the cam- 
era which is then recorded onto a separate magnetic so 
strip by means of separate recording/playback appara- 
tus. The strip may then be adhesively applied to the print 
or to the album page adjacent the print and the sound 
reproduced by means of a special playback apparatus 
with a reciprocating playback head which is placed 3$ 
against the strip. This arrangement requires a separate 
tape recording mechanism in the camera. The *472 pat- 
ent discloses the recording of digital audio information 
on a magnetic layer formed on a film. The digital audio 
information is in the form of a barcode. 10 
[0003] Additionally, there are three known commer- 
cially available systems for combining sound with still 
photographs. One is the "Talking Picture Frame" sold by 
Talking Pictures, Inc. which utilizes a special picture 
frame having a voice recording IC to record the sound 
in RAM chips in the frame. When the frame is lifted, a 
microswitch activates the IC to playback the recorded 
sound. 

[0004] Another system is the "Mini Box Comm" sold 
by Foto-Fonics, Inc. which utilizes a separate record/ so 
playback box to record sound on an adhesively backed 
strip adhered to the print. The print is inserted into the 
box for recording and playback and the print is in motion 
during both modes of operation. The third system is the 
Mavica electronic camera sold by Sony Corporation ss 
which isan lectronic camera as oppos d to a electronic 
film camera. Imag s are acquired by electronic sensors 
for recording on 2.5" floppy disc memories for subse- 



quent readout by electronic visual display means. 
Sound is recorded on the floppy disc for subsequent 
playback along with the recorded image. 
[0005] A problem with the photographic film system 
described above is that th magnetic strips, if kept inte- 
gral with the prints, are limited to use with instant print 
cameras. In the '854 patent, the sound must be written 
in a separate step involving the camera user which is a 
uncontrolled variable in providing the benefit as de- 
scribed. In the case of the system described in US-A- 
4,905,029, the sound is recorded on separate strips that 
may become lost or not easily associated with the prints 
when they are returned from the photofinisher. In the 
case of the picture frame the sound is recorded after the 
print is returned from the photofinisher thus losing the 
benefit of sound recorded at the time the picture is taken. 
[0006] It is an object of the invention to provide audio 
and visual information on a receiver produced by a print- 
er in an electronic camera. 

[0007] This object is achieved by a method of record- 
ing audio and image data on a receiver comprising the 
steps of: 

a) capturing audio information and converting it to 
digital signals; 

b) capturing an electronic image which corresponds 
to the captured audio information; 

c) recording the audio information on the receiver 
by applying a nonvisible ink to the receiver; and 

d) recording the electronic image by applying visible 
ink to the receiver. 

FIG. 1 is a schematic illustration of an electronic 
camera with an integral printer for recording au- 
dio and visual information according to the 
present invention; 

FIG. 2 is a schematic block diagram of audio 
recording and reproducing circuits useful in the 
camera of FIG. 1; 

FIG. 3 is a schematic block diagram of control 
circuitry for operating the image sensor of the 
electronic camera; 

FIGS. 4a, 4b, and 4c are illustrations of a re- 
ceiver illustrating different locations of the bar- 
code; 

FIG. 5 is a simplified diagram of hand-held ap- 
paratus for reading audio digital signals record- 
ed on the receiver of FIGS. 4a, 4b, or 4c; and 
FIG. 6 is a schematic diagram of playback cir- 
cuits useful in the hand-held apparatus of FIG. 
5. 

[0008] Referring to FIG. 1, an electronic camera 16 
with an integral printer 16a is shown which is specifically 
adapted to capture an electronic image by an image 
s nsor 14 (se FIG. 3) and print such an image. The 
integral printer 1 6a may, for example, be an inkjet printer 
which is adapt d to record images but also print a bar- 
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code format on receiver P such as shown in FIGS. 4a, 
4b, and 4c. Electronic camera 16 is provided with a built- 
in audi transducer, tor example microphone 17, a shut- 
ter button 15, and a miniature speaker 20. The shutter 
button 15 can take many forms known in the art, such 
as the two position switch which can, in the first position, 
provide an auto focus activation and, in the second po- 
sition, activate the camera shutter (not shown) to cap- 
ture an image. The electronic camera 1 6 is provided with 
a viewfinder 21 and will be understood to include the 
conventional elements found in electronic cameras. A 
receiver or print "P" is produced by the integral printer 
1 6a. A liquid crystal display (LCD) 1 8 is mounted on the 
integral printer 16a. After a user views the image on the 
LCD 18 and finds it acceptable, the user actuates the 
integral printer 16a by depressing a print button 16b. 
[0009] Referring to FIG. 2, there is shown an expand- 
ed block diagram of the circuits and components includ- 
ed in the audio recording and reproducing circuits of 
electronic camera 16. Buttons or switches 22 permit a 
user to provide inputs into a system microcontroller 23 
which condition the system microcontroller 23 to initiate 
and control the various operating functions of the elec- 
tronic camera 16. Among these functions are the sound 
recording and playback functions of the present inven- 
tion. Moreover, the system microcontroller 23 also re- 
sponds to the camera shutter button 15 to cause the 
capture of an image on an image sensor 14 as is well 
known in the art. Microphone 17 and speaker 20 are 
coupled to analog amplifier and data processing circuit 
24 to input and play back the audio. A sound processor 
integrated circuit (IC) 25 serves to convert analog sig- 
nals input from microphone 17 into coded digital infor- 
mation suitable for storage in a digital memory 26 and 
for converting the digital information into analog signals 
suitable for playback through speaker 20. Sound proc- 
essor IC 25 may be a Texas Instruments TMS3477 and 
digital memory 26 may be a random access memory 
(RAM) such as a Hitachi HM628128. One of the func- 
tions of digital memory 26 is to serve as a temporary 
storage location for the sound data associated with an 
individual captured image. Also shown is system bus 80 
which shown simplistically for clarity carries both ad- 
dress and data to all attached devices. 
[0010] Referring to FIG. 3, a schematic block diagram 
of the control circuitry for operating the image sensor 1 4 
with the system microcontroller 23 is shown. Condi- 
tioned by the system microcontroller 23, timing genera- 
tor 1 00 activates the logical sequencing of timing signals 
used to control the devices necessary to electronically 
capture an image. In order to operate the image sensor 
14 which typically can be a Charge Coupled Device 
(CCD), CCD drivers 102 receive signals from timing 
generator 100 which cause the generation of appropri- 
ate clocking signals that control the image integration 
time and data clocking of the image sensor 1 4. As imag 
data is clocked out of image sensor 14, it is subject to 
the analog signal processing 112 which can include a 



conventional correlated double sample and hold circuit 
which stabilizes the image data against known referenc- 
es before c nversion to representative image data dig- 
ital signals. Th image data digital signals are then sent 

£ to digital memory 26 (which stores the lectronic image) 
via system bus 80 as controlled by address generator 
104. To display the captured image on LCD 18, address 
generator 104 working in conjunction with timing gener- 
ator 1 0b cause the image data digital signals to be proc- 

10 essed by digital signal processor 110. Digital signal 
processor 110 is known to subs ample the image data 
digital signals to a resolution suitable for display on LCD 
18. The subsampled image data digital signals are then 
further processed by digital-to-analog (D/A) converter 

* 5 1 08 into analog signals which when received by display 
interface electronics 42 cause the image data signals to 
be displayed by LCD 18. Display interface electronics 
42, for example, contain the necessary elements to ob- 
tain a signal compatible with LCD 18 which usually takes 

20 the NTSC format well known in the art. 

[0011] Referring back to FIG. 2 when it is desired to 
record, sound in association with taking a picture, the 
camera user selects sound recording via a user input 
selector switch 22 that causes the system microcontrol- 

2S ler 23 to set the digital memory 26 to the "write* mode 
and then enables the analog amplifier and data process- 
ing circuit 24 for audio recording. Assuming the user de- 
sires to have image related audio, the user talks into the 
camera microphone 1 7 to identify the scene with appro- 

30 priate information such as date, time, f-stop, shutter 
speed, picture taking location, people in the scene, or 
aims the microphone to record live sounds from the 
scene. The data processing circuit 24 and sound proc- 
essor I C 25 convert the incoming analog signal to coded 

35 digital data which is then stored in the digital memory 
26. Audio may be recorded and stored in digital memory 
26 in this manner before, during or after the picture-tak- 
ing event 

[001 2] Once having stored the audio in digital memory 
40 26, the stored audio information can be reviewed by 
playing the stored information via speaker 20 in the cam- 
era. To do this, the user selects the " review" mode by 
means of a user input switch 22 which causes the mi- 
crocontroller 23 to set the digital memory 26 to the "read" 
45 mode thereby enabling the sound processor IC 25 and 
the analog amplifier and data processing circuit 24 to 
play back audio through speaker 20 If the recorded 
sound is not satisfactory, the user can easily change it 
by simply repeating the recording process described 
so above. It is thus apparent that the use of this digital 
memory 26 allows quick audio review and, if necessary, 
re-recording. 

[0013] The electronic camera 16 operates in two dif- 
ferent modes. In the first mode, after the shutter button 
65 1 5 is depressed, an image is captured and displayed on 
LCD 18. The user then decides if he or she is going to 
r cord audio information by depressing th appropriate 
switch 22. The audio information is stored in digital 
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memory 26. Thereafter, th user causes the receiver P 
to be made by depressing print button 16b which pro- 
vid s a signal to the printer controller 28. Th printer 
controller 28 is also adapted to r ceive the captured dig- 
ital imag from the image sensor 14 and to apply such 
digital image to the integral printer 1 6a. 
[001 4] I n the second mode, the user desires to simul- 
taneously capture audio information and record a pic- 
ture. This is accomplished by conditioning the camera 
system microcontroller 23 by an appropriate input from 
one of the switches 22. In this case, the audio informa- 
tion will begin to be recorded directly onto a receiver 
when the shutter button 1 5 is activated to a first position. 
The image is captured upon activation of shutter button 
15 to a second position. The total available recording 
time is fixed, for example, at 10 seconds. The audio re- 
cording and direct printing occurs for the 1 0 seconds si- 
multaneously following the activation of shutter button 
15. 

[0015] As has been described above, the integral 
printer 1 6a can be an inkjet printer which can record dig- 
ital images and barcode data corresponding to audio in- 
formation. The system microcontroller 23 shown in FIG. 
2 can cause various different formats to be used which 
will be discussed in connection with FIGS. 4a, 4b, and 
4c. The barcode information is recorded by the inkjet 
printer as an ink responsive to light in the infrared (IR) 
portion of the spectrum. Nonvisible IR responsive inks 
can be used in accordance with the present invention. 
For examples of dyes that can be dispersed in a liquid 
medium and are responsive to light in the infrared por- 
tion of the spectrum and can be used by an inkjet printer, 
see US-A-5,691,114, columns 9 and 10. 
[0016] Turning now to FIGS. 4a, 4b, and 4c which are 
illustrations of a receiver illustrating different locations 
of the barcode. FIG. 4a depicts a situation where the 
barcode 45 is provided along the margin or one of the 
edges of the receiver P. As shown in FIGS. 4b and 4c, 
the barcode 45 is recorded in tracks over the entire im- 
age. In FIG. 4b, the barcode 45 corresponding to the 
audio information was first recorded prior to the record- 
ing of the image. In FIG. 4c, the barcode 45 was record- 
ed after the image was recorded. 
[001 7] Having recorded digital audio signals on the re- 
ceiver as described above, the sound subsequently may 
be reproduced by means of a portable, hand-held play- 
back device 50 shown in FIG. 5 having a form factor 
about the same as a credit card and only slightly thicker. 
Such a device comprises a button battery power source 
51, a memory storage IC 52, an optical IR emitter/de- 
tector pair 53; a sound data decoder IC 54, a planar 
speaker 55, analog drive circuits 56, and digital control 
logic unit 57. 

[0018] Referring to FIG. 6, functional block diagram 
of circuitry for the device of FIG. 5 comprises user input 
buttons 58 coupled to digital control logic unit 57 which 
controls the operation of sound data decoder IC 54 and 
an analog drive circuits 56 which includes sp aker am- 



plifier 56a and analog drive and amplitude comparator 
unit 56b. The latter unit is coupled to the optical IR emit- 
ter/detector pair 53 which operates to sense the record- 
d barcode audio digital signals on the receiver (see 

s FIGS. 4a, b, and c) and to produce a digital output signal 
which is temporarily stored in memory storage IC 52. To 
play back the audio from the recorded audio digital sig- 
nals on the print, the user enables the hand held reader 
by pressing an "on" switch of user input buttons 58 which 

io causes digital control logic unit 57 to set memory stor- 
age I C 52 to the "store" mode and also to enable an LED 
(not shown) to indicate the "power on" status. Next the 
user scans the optical emitter of optical IR emitter/de- 
tector pair 53 over the encoded audio information shown 

« as a barcode pattern. Preferably the data is encoded in 
a self-clocking format such as is described in US-A- 
4,876,697 or in US-A-4,954, 825, the disclosures of 
which are incorporated herein by reference, in order to 
make the reader scanspeed tolerant. While scanning, 

20 the unit decodes the printed pattern back into digital data 
and stores it in the local memory. Once scanned, the 
receiver is held in a comfortable manner to be observed 
while the audio player input switch is activated; The dig- 
ital control logic unit 57 then proceeds to set the memory 

25 storage IC 52 to read, and to enable the sound data de- 
coder I C 54 to convert the digital signal data to an audio 
signal which is passed via the amplifier to the speaker. 
A particular advantage of such an arrangement is that 
the user can replay the audio as many times as desired 

30 without re-scanning the print, since the data is retained 
in the digital memory storage IC 52 until power is re- 
moved or until the user clears the memory via the user 
input buttons 58 and digital control logic unit 57. 
[001 9] Other features of the invention are included be- 

35 low. 

[0020] The method wherein the recorded audio digital 
signals are in the form of a barcode recorded in the same 
area of the receiver as is the recorded visual image. 
[0021] The method wherein the barcode is recorded 

40 in a plurality of spaced tracks on the receiver. 

[0022] The method wherein the barcode is recorded 
near at least one edge of the receiver. 
[0023] In an electronic camera which includes a print- 
er for recording audio and image data on a receiver com- 

45 prising the steps of: 

a) means for capturing audio information and con- 
verting it to digital signals; 

b) means for capturing an electronic image which 
so corresponds to the captured audio information; and 

c) control means responsive to the audio digital sig- 
nals and the captured electronic image for causing 
the printer to record audio information on the receiv- 
er by applying an IR responsive ink to the receiver 

55 and record the electronic image by applying visible 
ink to the rec iver. 

[0024] The I ctronic camera wherein a plurality of 
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colored inks are r corded on the receiver which corre- 
spond to the lectrpnic image. 
[0025] The lectronic camera wh r in the recorded 
audio digital signals are in the form of a barcode record- 
d in the sam area of the rec iver as is th recorded 
visual image. 

[0026] The electronic camera wherein the barcode is 
recorded in a plurality of spaced tracks on the receiver. 
[0027] The electronic camera wherein the barcode is 
recorded near at least one edge of the receiver. 
[0028] The electronic camera wherein the control 
means first causes the audio digital signals to be applied 
to the receiver and thereafter causes the visible ink to 
be applied to the receiver. 

[0029] The electronic, camera wherein the control 
means first causes the visible ink to be applied to the 
receiver where a user can preview it and then causes 
the audio digital signals to be applied to the receiver. 

PARTS LIST 



112 analog signal processing 



Claim 

1 . A method of recording audio and image data on 
a receiver comprising the steps of: 

' a) capturing audio information and converting 
10 it to digital signals; 

* b) capturing an electronic image which corre- 
sponds to the captured audio information; 

c) recording the audio information on the re- 
ceiver by applying a nonvisible inkto the receiv- 
es ..er; and 

d) recording the electronic image by applying 
visible ink to the receiver. 

2. The method of claim 1 wherein the nonvisible ink 
20 is an IR responsive ink. 



[0030] 

P receiver or print 

1 4 image sensor 

15 shutter button 

16 electronic camera 
16a integral printer 
16b print button 

17 microphone 

18 liquid crystal display 

20 speaker 

21 viewfinder 

22 buttons or switches 

23 microcontroller 

24 data processing circuit 

25 sound processor integrated circuit 

26 digital memory 
28 printer controller 

42 display interface electronics 

45 barcode 

50 hand-held playback device 

51 button battery power source 

52 memory storage IC 

53 optical IR emitter/detector pair 

54 sound data decoder IC 

55 planar speaker 

56 analog drive circuits 
56a speaker amplifier 

56b amplitude comparator unit 

57 digital control logic unit 

58 user input buttons 
80 system bus 

100 timing generator 

102 CCD drivers 

104 address generator 

108 digital-to-analog (D/A) conv rter 

1 10 digital signal processor 
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3. The method of claim 1 wherein a plurality of color- 
ed inks are recorded on the receiver which corre- 
spond to the electronic image. 

4. The method of claim 1 wherein the recorded au- 
dio digital signals are in the form of a barcode re- 
corded in the same area of the receiver as is the 
recorded visual image. 

5. A method of recording audio and image data on 
a receiver comprising the steps of: 

a) capturing audio information and converting 
it to digital signals ; 

b) capturing an electronic image which corre- 
sponds to the captured audio information; 

c) first recording the audio information on the 
receiver by applying an IR responsive ink to the 
print; and 

d) after application of the IR responsive ink, re- 
cording the electronic image by applying visible 
ink to the print. 

7. The method of claim 6 wherein a plurality of color- 
ed inks are recorded on the receiver which corre- 
spond to the electronic image. 

8. The method of claim 6 wherein the recorded au- 
dio digital signals are in the form of a barcode re- 
corded in the same area of the receiver as is the 
recorded visual image. 

9. A method of recording audio and image data on 
a receiver comprising the steps of: 

a) capturing audio information and converting 
it to digital signals; 
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b) capturing an electronic image which corre- 
sponds to the captured audio information; 

c) first recording the electronic image on the re- 
ceiver by applying colored inks to th print; and 

d) aft r r vi wing the recorded visible image, £ 
applying nonvisible ink to the receiver corre- 
sponding to the audio digital signals. 

10. The method of claim 9 wherein a plurality of 
colored inks are recorded on the receiver which cor- 10 
respond to the electronic image. 
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FIG. 4a 
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FIG.'. 5 
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